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performing various behaviors judged to be important to the learning 
process in the system of individualized instruction upon which 
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instrument in comparing PLAN students with students in other 
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observation and analysis, paired and carefully trained observers (one 
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activities engaged in and considered essential characteristics of the 
process of individualized instruction. (Also included are differences 
revealed by the instrument, although not at the statistically 
significant level, and an outline of the observer training program.) 
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In order to assess the classroom behavior of PLAN students relative to 
students in other instructional systems, the PLAN Student Observation Scale 
(PLAN-SOS) was developed. The purpose of PLAN-SOS is to measure the precent- 
age of time that students spend performing various behaviors judged to be 
important to the learning process in a system of individualized instruction. 

Many student observation scales have been developed for a variety of 
specific uses. Some have been designed to record the occurrence of a cir- 
cumscribed set of student classroom behavior such as attending behavior 
(Walker & Buckley, 1968), study behavior (Hall, Lund, & Jackson, 1968), 
and disruptive behavior (Thomas, Becker, & Armstrong, 1968). Other scales 
have been constructed to examine a broader group of behaviors. Spaulding, 
for example, developed "A Coping Analysis Schedule for Educational Settings" 
(CASES) to record both verbal and non-verbal behaviors in the affective 
domain (Simon & Boyer, 1967). Another scale was developed by Lindvall 
specifically for the observation of students in an individualized system of 
instruction (Simon & Boyer, 1967). 

PLAN-SOS was designed to correspond to the training program for teachers ✓ 
of PLAN classes (see Steen, Quirk, and Lipe, 1969, for a description of the 
trai ning program) . 

In an earlier paper (Lipe, Quirk, & Steen, 1969), comparisons between 
classrooms of PLAN and Control students were presented. It was found, as 
predicted, that PLAN students spent more time than Control students working 
alone on various learning activities, that PLAN students spent more time 
than Control students in individual instruction with their teachers, and 
that PLAN students spent more time than Control students in learning acti- 
vities with their peers. Contrary to predictions, PLAN students did not 
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spend more time than Control students in planning and developing strategies 
to follow a Program of Studies. 

The purpose of this paper is to present comparisons between various 
groupings within the set of PLAN classes. Lor comparison purposes class- 
rooms are grouped by grade level, by teacher experience writing PLAN curri- 
culum materials, and by instructional organization of the classroom, i.e., 
team vs. self-contained. 



Brief Description of PLAN-SOS 

Listed below are the 20 categories of the PLAN-SOS. They represent the 
end product of the development of mutually exclusive and exhaustive categories 
that observers may employ to reliably and usefully describe activities of 
PLAN students. 



Student Behavior Categories 



Category 

Category Description Number 



Example 



WORKING ALONE ON 

Computer materials 



The student fills out a computer 
(1) request card. 



Learning materials 
Learning equipment 
Tests 

INTERACTING IN A GROUP 

Attending to the teacher 

Attending to a student 




( 2 ) 

(3) 

(4) 

(5) 

( 6 ) 
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The student checks off a TLU 
activity. 

The student is listening through 
earphones to a record. 

The student is writing an essay 
answer to a test. 



The student is watching the 
teacher work a problem. 

The student is attending to 
another student in the group who 
is asking a question. 














Talking or performing (7) 

INTERACTING WITH THE TEACHER 

Content behavior (intra TLU) (8) 

Process behavior (extra TLU) (9) 

Silent attending (10) 

INTERACTING WITH A PEER 

Content behavior (intra TLU) (11) 

Process behavior (extra TLU) (12) 

Silent attending (13) 

PLANNING LEARNING STRATEGIES OR 

PROGRAM OF STUDIES (14) 

TRANSITIONAL BEHAVIOR 

Walking (15) 

Waiting for the teacher (16) 

Other waiting (17) 

Locatino or organizing materials 
and equipment (18) 

NON-PRODUCTIVE BEHAVIOR 

Interacting (19) 

Not interacting (20) 
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The observed student is answering 
a question asked by the group leader. 



The student asks the teacher for 
the meaning of a word in his TLU. 

The student answers the teacher's 
question about how far he has 
progressed in his Program of Studies 

The student listens to the teacher 
explain something to him. 

The student asks another student how 
to work a math problem. 

The observed student tells another 
student where to find a book. 

The observed student attends to 
another student who is asking a 
question. 



The student and teacher are 
discussing the student's Program 
of Studies. 



The student is walking from his 
desk to the bookcase. 

The student is standing in line 
at the teacher's desk. 

The student is waiting to use a 
tape recorder. 



The student is putting earphones 
on his head. 



The student is describing to 
another student the details of 
a TV program. 

The student is gazing out the 
window. 
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'The 20 categories of PLAN-SOS are clustered into seven groups which 
correspond to the major emphases of the teacher training program. These include 
traininq teachers to teach children how to manage their own classroom behavior 
(Categories 1, 2, 3, 4, 11, 12, 13, and 18), training teachers how to work with 
small qroups of children (Categories 5, 6, and 7), training teachers how to work 
individually with children (Categories 8, 9, and 10),* and training teachers 
how to teach children to plan their own studies (Category 14). Categories nine 

and 12, "Process Behavior," represent tutoring sessions which focus on problems 

v 

of organizing the student's work and preparing for the learning activities. 

\ 

Categories 8 and 11, "Content Behavior," represent tutoring sessions which 
focus on problems of the actual learning activities themselves. 

Training Classroom Observers to Use the Scale 

Four observers were trained to use the PLAN-SOS and the training procedure 
was replicated with a second group of four observers. All observers in both 
groups were women. Those in the first group ranged in age from 23 to 35; their 
education ranged from one year of college to one and one-half years of graduate 
study. Two had had no teaching experience, one had taught three years in public 
school and one observer had taught five years. The second group ranged in age 
from 25 to 41. One had attended college for three years and the other three 
each had earned a Bachelor's Degree. The number of years teaching experience 
represented in the group was none, one, two, and four years. 

A brief outline of the training program is presented in Table 1. The 
objective of the observer training was to attain inter-observer reliability of 
.85 or better as auickly and economically as possible. Observers were given 
extensive practice categorizing first written narratives describing student 
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behavior and then observing and categorizing actual student classroom behavior. 
Training included frequent assessment of observer progress and feed-back 
regarding observer successes and solutions to observation problems. Observers 
were given practice in all levels of PLAN classes and also in all corresponding 
levels of non-PLAN classes. 

Following the training of each group a reliability study of the instrument 
was conducted. Scott's tt was employed as the statistic to assess reliability 
(Flanders, 1967). Reliabilities of Group I observers are presented in Table 2 
and those of Group II observers are presented in Table 3. 

Data Collection 



For a complete description of the observed population see the paper by 
Quirk, Steen, and Lipe (1969). The distribution of Project PLAN classes is 
presented in Table 4. 

Each classroom of this study was observed on three separate occasions each 
for 20 minutes to provide a total of one hour's observation on each class of 
students. A pair of observers entered each classroom. One member of the pair 
observed and recorded teacher behavior; the other observed and recorded student 
behavior. The student observer systematically scanned the classroom, observed 
and recorded the behavior of a different student every five seconds until every 
student's behavior had been recorded once, and then rescanned the classroom 
observing every student a second time. This process was repeated for the duration 
of the 20 minute observation period. 

Data Analyses 

Comparisons among groups of classrooms within PLAN are presented in Tables 
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5-10„ The tables show the percentage of time spent in all 20 categories of 
behavior and in six grouped categories. Mann-Whitney U values were computed 
for those categories in which the differences between percentages of a pair of 
comparison groups were five percent or greater. In the comparisons among three 
groups, Kruskal-Wallis H values were computed for the categories in wlrich the 
difference of any pair of groups was five percent or greater. Since there were 
no predictions regarding the directionality of differences, two tailed tests 
were applied to the U and H values. 

Comparison of PLAN Students: Primary vs. Intermediate vs. Secondary Levels 

Tables 5 and 6 present the data comparing levels of PLAN students. The Kruskal- 
Wallis H test was significant regarding category 3, category 18, the combined 
Transitional category (15+16+17+18), and the combined Non-productive category 
(19+20). In category 3, Working Alone on Learning Equipment, primary level PLAN 
students spent significantly more time than intermediate level PLAN students and 
the latter spent significantly more time than secondary level PLAN students. In 
category 18, Locating and Organizing Materials and in the combined category for 
Transitional behavior (15+16+17+18), both primary level students and intermediate 
level students spent significantly more time than secondary level students. Se- 
condary students, however, spent significantly more time than both intermediate 
level students and primary level students in category 19, Non-productive behavior 
(19+20). 

An interesting finding in this section regards the inverse relationship 
between the amount of time spent working alone on learning equipment and level 
of PLAN student. The higher the level of the students, the less time was 
spent working alone on learning equipment. There is no basis at this time. 
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however, for presenting as a future hypothesis that this relationship is 
generally true. The finding that secondary level students spent more time than 
the lower levels of students in non-productive behavior, on the other hand, 
has guided the emphases and direction of the teacher training during the 
current year. Likewise, the current teacher development program includes 
new techniques for reducing the amount of time all levels of students spend 
locating and organizing materials and in other transitional behavior. 

Comparison of PLAN Students: Level One vs. Level Two 

Level one students were experiencing their first year in school as well 
as their first year in PLAN. Level two students, in addition to experiencing 
their second year of school, were, in many cases, also experiencing their second 
year in PLAN. Comparisons between PLAN level one and level two students are 
presented in Table 7. The only significant difference was that level one students 
spent more time than level two students working alone on learning equipment. 

Comparison of PLAN Students: Students of First Year PLAN Teachers vs. Students 

of Second Year PLAN Teachers (all levels) 



Thirty-six of the teachers in 1968-69 PLAN classes were in their first year 
of PLAN teaching and twenty-two were teaching PLAN for their second year. The 
comparison of first year PLAN teachers with second year Pi_AN teachers are pre- 
sented in Table 8. In none of the categories are the differences between groups 
equal to or greater than five percent. No tests of group differences, therefore, 
were applied. 
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Comparison of PLAN Students: Students of AIR-PLAN Teachers vs. Students of 



non-AIR-PLAN Teachers 



In the development phase of Project PLAN participating school districts 
each year send teachers to AIR in Palo Alto to write curriculum materials for 
those grade levels that will be added to the project the following year. We 
wanted to know whether spending a year writing curriculum materials would in- 
fluence the effect teachers had on student behavior in PLAN classes as measured 
by the SOS. 

Comparisons between those groups of teachers are presented in Table 9 and 
none are significant. 

Comparison of PLAN Students: Students of Team Teachers vs. Students in Self- 

Contained Classrooms (Primary and Intermediate Level Students Combined) 

At the primary and intermediate levels, 26 PLAN teachers worked in teams 
sharing responsibilities for their combined classrooms. The other 16 teachers 
at those grade levels taught in self-contained classrooms. 

The comparisons between students of team teachers and students in self- 
contained classrooms are presented in Table 10. Again there were no categories 
in which differences between groups equalled or exceeded five percent and, 
therefore, no test of significance was applied. 

Discussion 

It is noteworthy that many of the comparisons between groups of students 
within PLAN were not significant. Primary, intermediate, and secondary students, 
for example, did not significantly differ in the amount of time spent working 
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alone, interacting in a group, interacting with the teacher, or interacting with 
peers. None of the comparisons on two dimensions of teacher experience yielded 
any differences in measured student classroom behavior. And, finally, the dis- 
tributions of student activities we^e almost identical in classrooms of team 
teachers as in self-contained classrooms. 

On one of the assessed dimensions of teacher experience, i.e., whether or 
not the teacher has spent a year at AIR writing PLAN curriculum materials, the 
lack of differences perhaps can be attributed to the lack of similarity between 
curriculum writing skills and teaching skills. Even though a teacher has spent 
a year writing PLAN Teaching-Learning-Units in one subject area to be used in 
his classroom the following year, he is not necessarily going to be better 
prepared than other teachers to teach students in all four subject areas of PLAN. 

It should also be pointed out that, at the time of the observations, all teachers 
had had almost eight months experience teaching PLAN classes. Even though differ- 
ences between groups were not identified to exist in the spring of the school 
year, it is possible that such differences did exist the previous fall. The 
intensive inservice training of individual teachers by field consultants in 
areas of each teacher's special needs also may have been a factor in eliminated 
differences if difference had existed earlier in the year. 

It is by definition a characteristic of an individualized classroom that 
a variety of activities be occurring at any one time. If students' needs differ, 
then it is to be expected that learning activities in accordance with those needs 
also will differ. The wide variety of activities commonly occuring in any one 
PLAN classroom at one time also may contribute to the lack of significant 
differences between groups of classrooms. It is well documented that a wide range 
of measured abilities is typically represented in a school's grade level. 

The areas where differences were found between compared groups have served 
to guide the emphases of the training program for PLAN teachers this academic year. 
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Table 1 



Brief Outline of the Observer Training Program 



I. Pre- training Orientation Session (about two hours) 

A. Complete the "First Practice Trials Categorizing Student and Teacher 
Behavior". 

B. Read "Operational Definitions of Student Behavior Categories". 

C. Peruse materials describing Project PLAN. 

II. Orientation to Project PLAN Classrooms (about one-half day) 

A. Take a clip board with stop watch and observation forms. 

B. In several PLAN classrooms the trainer will point out examples of the 
student behavior categories as they occur. 

III. Simulated Practice (about one-half day) 

A. Practice categorizing written examples of student behavior. 

B. Practice tallying responses and computing Scott's 

IV. Practice Observation with Frequent Feed-back (as needed) 

A. In pairs, in a functioning classroom,, discuss student behavior (about 
five minutes). 

B. Independently categorize student behavior (two minutes). 

C. Compare and discuss categorization decisions. 

D. Repeat B and C for about 20 minutes. 

E. Outside the classroom discuss unresolved questions and problems with 
the trainer. 

V. Trial Reliability (as needed) 

A. In pairs, independently observe students in diverse classrooms for 
about 20 minutes each. 

B. Computer observer reliability in each classroom. 

VI. Formal Reliability Study of the Instrument 



- 11 - 






Table 2 

Observer Reliability 
PLAN-SOS 
Group I 




Grade Scott *s tt 



Level 


Observer 


Project PLAN 


Traditional 


Observed 


Pair 


classes 


classes 


Primary 


A-B 


.96 .92 


.86 .96 


(Grades 1 & 2) 




C-D 


.93 .99 


.73 .88 


Intermediate 


A-C 


.95 .76 


.95 .90 


(Grades 4, 5, & 6) 




B-D 


.98 .82 


.96 .60 


Secondary 


A-D 


.95 .88 


.86 .93 


(Grades 9 & 10) 




B-C 


.53 .98 


.89 .95 




r 



Table 3 

Observer Reliability 
PLAN-SOS 
Group II 



Grade 

Level 

Observed 


Observer 
Pa i rs 


Scott's TT 

Project PLAN 
classes 


Traditional 

classes 


Primary 


A-B 


.88 


.82 


.74 


.72 


(Grades 1 & 2) 




C-D 


.90 


.97 


.98 


.91 


Intermediate 


A-C 


.93 


.81 


.89 


.95 


(Grades 4, 5, * 6) 




B-D 


.93 


.93 


.93 


.93 


Secondary 


A-D 


.80 


.74 


o 

o 

• 


.86 


(Grades 9 & 10) 


B-C 


.90 


.93 


.64 


.67 
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Table 5 



Comparison of PLAN Students: Primary vs. Intermediate vs. Secondary 



Category 




Frequency 


Percent 


Frequency 


Percent 


Frequency 


Percent 


Kruskal- 
Wa 11 i s 




PLAN 

Primary Students 
(N=21 classrooms) 


PDTO 

Intermediate 

Students 

(N=21 classrooms) 


PLAN 

Secondary Students 
(N=16 classrooms) 


Working Alone 


H 


1. Comp. mat. 


4 


0.02 


85 


0.56 


218 


1 .89 




2. Learn, mat. 


5393 


35.66 


5742 


37.97 


3724 


32.32 


1 .25 


3. Learn, equip. 


1013 


6.69 


544 


3.59 


155 


1 .34 


18.54'*'* 


4. Tests 


65 


0.42 


596 


3.94 


353 


3.06 




Interacting in a Group 


5. Attend, to tch. 


907 


5.99. 


670 


4.43 


1122 


9.73 


3.05 


6. Attend, to stud. 


313 


2.07 


313 


2.07 


620 


5.38 




7. Talk, or perf. 


176 


1.16 


109 


0.72 


116 


1 .00 




Interacting with Teacher 


8. Content beh. 


258 


1.70 


147 


0.97 


89 


0.77 




9. Process beh. 


51 


0.33 


45 


0.29 


43 


0.37 




10. Si 1 . att. 


488 


3.22 


422 


2.79 


246 


2.13 i 




Interacting with Peers 


11. Content beh. 


553 


3.65 


574 


3.79 


543 


4.71 




12. Process beh. 


56 


0.37 


48 


0.31 


29 


0.25 




13. Si 1 . att. 


395 


2.61 


421 


2.78 


367 


3.18 




Other 


14. Plan, learn, strat. 


19 


0.12 


9 1 0.05 

L 


18 


0.15 


large. 


Transitional 


15. Walking 


1628 


10.76 


1574 


10.41 


680 


5.90 




16. Wait, for tch. 


537 


3.55 


561 


3.71 


258 


2.23 




17. Other wait. 


46 


0.30 


33 


0.21 


37 


0.32 




18. Loc. or org. mat. 


1630 


10.78 


1667 


11.02 


646 


5.60 


22.14** 


Non-productive 


19. Interacting 


978 


6.46 


983 


6.50 


1749 


15.18 


12.20** 


20. Not interacting 


610 


4.03 


577 


3.81 


507 


4.40 




Alone (1 +2+3+4) 


6475 


42.82 


6967 


46.07 


4450 


38.62 


2.88 


Group (5+6+7) 


1396 


9.23 


1092 


7.22 


1858 


16.12 


2.15 


Teacher (8+9+10) 


797 


5.27 


6T4 


4.06 


378 


3.28 




Peer (11+12+13) 


1004 


6.64 


1043 


6.89 


939 


8.15 


2.63 


Trans. (15+16+17+18) 


3786 


25.03 


3835 


25-. 36 


1621 


14.07 


27.3** 


Non-prod. (19+20) 


1643 


10.86 


1560 


10. 3T 


2256 


19.58 


8.86* 


TOTAL (1 through 20) 


15120. 




15120 




11520 







? 




Comparison between Levels of PLAN Classrooms on categories for 
which the overall Kruskol-Wallis H Tests were Significant 



1 




I 
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